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„. V". C f re " t debate kerning ««> appropriateness of a set of national 
stewards for educational achievement in the United States has been coupled 

nStoZr 1 > « T emin8 4116 UtiUty ° f 8tandarfi ^ ^ (a) in the 
monitoring of educational progress and (b) as a basis for credential^ for a 

T»r°Z ° f "T 868 - Unf0rtUDatel * «* of- who prefer to Z with 
simple problems, this one is complex beyond measure. 

fron^r TTr t0Ttbe8e C ° mpIe " ties iB *» ubi 1^ ^tortious which flow 
rZ^A t J r' "* 0ther f0mW ° f ^vinism in our society. 

These distortions have been traditionally thought to be unrelated to the 
processes of education and educational assessment. This is because the 
tendency has been to focus on the impact of racism and sexism on the persons 
who are the targeted victims of such communicentric bias and not « tZ 
social processes and institutions which reflect those biases. But all of us and 
aU segments of our society are victims or possible victims. The distortions and 
otherw.se negative fallouts have an impact on practicaUy all that we seek to 7o 
Nowhere is tins more obvious than in our efforts to educate diverse populations 
and o assess the educational needs and outcomes in people wise life 
condifons experiences and values differ from those which have achieved 
hegemony in the society. ea 

" CTcdit of T of ^e recent efforts at reform in the 

psychometric community that several of us have agreed to try to engage 
seriously the possible implications of diversity in human **JL£ZZl 
more useful and hopefully equitable assessment technology. We seem to have 
agreed to try to make assessment procedures more authentic with respect to 
what we know about earning and human competence, as well as with rasped 
to the various populations whose members will be assessed. The concern with 
authenticity has focused on the development of assessment p^TS 
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may not be sufficiently responsive to the diversity in human populations Our 
concern for authenticity also requires that we recognize ZthTae varies 
pop^ons hve their lives in multiple contexts, and Z^u^^ZTZ 
no only with population, but also with contexts. Thus, * modemXZ 

ST^LT*" *? C ° mPeteaCe * * -*» -iterial 

within the same person functioning in multiple contexts. 

htJlZT?" Peri0d 8 C ° nCem for * uthen «<= assessment would probably 
standardized procedures were adhered to. But today we are likelv to bo 

aZr* ™ more pByd,ometric prowems «i 

assessment processes among which are the problems of test bias, which have 
been deah with to the satisfaction of many psychometrician but whtoh 
confanue to frustrate some educators and advocates for civil rights OthT of 
us are debating questions as to whether to use standardized teTatT^ 
argument advanced is that traditional standardized items tond to 

p3Zfm? te ? ? mC ° f ^ a ^ e «»t these 

procedures and tests penalize not only our weakest students, but manv of 0U r 

most creatively intelligent members. Some of us are ready to ZU Z 
insist that it must be possible to develop assessment procedures which are a 
work, and that are less dependent on recall and regurgitation. 

but insist that it » immoral to begin by measuring outcomes before we have 
ZTrl ^T' eqUitab ' e ^ 8Uffid6nt «■""*» of inputo, tnat u 

ZST so T es8cntial t0 4116 development of 

Zhometric oed ** qUe8ti ° nS ° f te8til * « the face of 

psychometric, pedagogical, politicd, economic, psychological, cultural and 
Philosophical problems, and there appear to be few who are prepa^tt^ 
such convex prob.ems from these several perspectives. Not £t ZZZ 



ERIC 



6 



tendency to approach these issues from simrl- ,r„ • i- 

personal and Vetoes hegemon* * ** ^ 

the LldtL r^pe^e 0 l MnmUniC8ntriC *T to see 

and to BenerauT^nT^7 ° fmy nam>w *™P membership and interest, 

their pellet tJ?!. * oth " communities and 

copies, lnis communicentric bias i& j • 

class, culture, ethnicit y , gender. andTan™ ^7 """"f" 40 
interests of these groups have begun to remmT" th» t ' ^ *" 

and socialaation have import tZ^s oTiTt T" 
character of adaptive functions and tZ . k" ^ ° f 

influence what we 1a»™ »u Iearmn g- They argue .hat such variables 

retrieve JormaZ, Z' t " ^ how -to* and 

and more ^2 IZltZL'^Z ^ 

influence our JLJ^S^^ wS^T'^ IS"" ^ 40 
and technique I assume tKof T re8pect to knowledge, intellect 

influence ^ 1^21*? ^ *— * "* 

in their highest forms. JUdgement - candidates for cognitive products 

^"ZZTLlT B t - *• — - Anne 

take questions £tj f ^ ** « 

ahe was complaining 1^^^^^^ ^ ^ 
have given up on the validity ^0^ " ^ technolog,sis to 
validity through assumptions^^ Un-o^h * h " t 

assume commonality or hetroZeit Zt T"^^ We 

influenced by racism sexi™ T ° W the8e "aumptions 

' racism, sexism, classism, or in the r . 

nationalism? ne ca8e of language, 

society for their implications for the achievement of »Tf ? M m 

and justice in educational assessment ^ **" ° f ^ 

We begin with the conviction that it is desirable that k • 

questions of equity early in the development^ a^metf ^ 40 

F OT 811 assessment process rather 
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than as an add-on near the end of such work. Since this issue is more 
complicated than is often reflected in the public debates, it may be useful to 
identify some of the possible ways in which a concern for population diversity 
and pluralistic outcomes impact upon development and learning. It is 
becoming more and more obvious that these sources of variance iriluence: 

1. the motivation to engage academic learning and to master its content; 

2 ' SKST"*"" tolearafa>dbe reinforced by academic competence and 

3. the conditions in and under which knowledge is learned and attitudes 
are developed toward the disciplines; and attitudes 

4. the nature of the processes by which academic attitudes, knowledges 
competencies, and skills are assessed. Knowledges, 

These and other adaptive behaviors are certainly influenced by such social 
divisions as race and gender. But an exclusive focus on racism or sexism may 
be less useful for our purposes. Instead, a focus on the implications of diversity 
and pluralism might better enable us to address the relevant concerns. I refer 
to class, cultural, ethnic, gender, and language diversity, all of which are 
possible influences on the manner in which knowledge is acquired and the 
manner in which academic attitudes and knowledge are produced in 
assessment demands. It is not clear how much attention we should give to 
other aspects of diversity such as cognitive style, motivation, and 
temperament What is dear is that if we are to adequately assess achievement 
and to use that assessment information to improve education, we will need to 
find ways in which to appropriately accommodate relevant sources of diversity 
in our revised examinations. 

A related issue concerns the question of pluralism, that is the 
requirement that our students are expected to meet different standards in the 
multiple contexts in which they live their lives. Obviously, purposes 
perspectives, and goals influence what is learned as well as what one is 
willing to produce. Thus, the assessment problems relate to the 
appropriateness of the examination probes to the purposes, goals, and 
standards of the person being examined. In addition, there needs to be concern 
for the appropriateness of the examination to a context that is pluralistic as 
well as for the extent to which the standard context can be made to 
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accommodate these pluralistic ends without distorting the purposes which are 
to be served by the examination. Ideally, we want our students to be able to 
function in multiple contexts and to meet multiple standards. The fact of 
pluralism in our society makes that necessary; however, current approaches 
to assessment do not address this problem explicitly. 

It is not by accident that existing approaches to standardized assessment 
are insufficiently sensitive to diversity and pluralism. Dominant standards by 
which academic competence is judged are calibrated in large measure against 
either (a) what most persons at a specific level can do, or (b) what we agree is 
necessary in order for one to take on the next level of work. The fact that some 
persons have greater difficulty than others or seem unable to achieve that level 
is thought to be a problem of person characteristics and not a problem with the 
appropriateness of the measurement or discipline. 

In our efforts at being responsive to diverse human characteristics and 
plural social standards, there may be limits to what can be done in the design 
and development of assessment procedures. We may be able to make the 
assessment process more instructive and supportive of instruction. We may 
find vaned contexts in and vehicles through which students can demonstrate 
their competencies. Our items could be made more process sensitive and give 
less emphasis to product. But in the final analysis, the assessment procedure 
is most likely to reveal the effectiveness of the teaching and learning which has 
occurred. Thus, the facts of diversity and pluralism may have more serious 
implications for teaching and learning than for assessment. However, this 
differential in favor of teaching and learning does not eliminate the 
assessment community's responsibility to be responsive to the facto, problems 
and challenges of diversity and pluralism. 

This is the challenge to authentic assessment, however, it is essential that 
we understand and agree that this concern with diversity, pluralism and 
equity rests upon a commitment to universal standards of competence, that is 
the same standards for all populations, even though we may be able to agree' 
upon differential indicators of change or progress toward those standards 
Standards or criteria for competence or mastery cannot be based upon different 
entry or exit characteristics of learners. Population specific norms may be 
useful in planning pedagogical intervention, but are irrelevant to certification 
Yet, if we are to measure progress, our instruments must be sensitive to 
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changes mthin specific populations. The task then is to find assessment 
probes (test items) which measure the same criterion from contexts and 
perspectives which reflect the life space and values of the learner. Our 
mdxcators must be valid with respect to the criterion used and must be capable 
of ebating culturally indigenous behaviors which may reflect incremental 
movement toward the chosen criterion. To do this will require that we find 
ways to provide students with learning and testing opportunities which are 
appropriate to the standard, equivalent to the standard, and sufficient to evoke 
a relevant response. These may be approached through attention to the 
engagement potential and interest power of our probes, through the relevance 
of reference points, and the capacity of items and tasks to be mapped on the 
learner s existing schema, style, or response repertoires. 

This kind of fluidity or flexibility in our probes will require that we come to 
some agreement concerning the core knowledges, skills and understanding 
whach are fundamental to developed intellect and then permit some choice to 
the examinee and examiner with respect to how and in which knowledge, 
stall, and understanding subdomains the examinee demonstrates her or his 
competence. 

Thus options and choices become a critical feature in any assessment 
system created to be responsive to equity, just as pncessual description and 
diagnosis become central purposes. There follow a few examples of what our 
assessment probes should provide: 

1. Diversity in task content, contexts, demands and referents; 

2. Flexibility in timing entry points, time span of performance, etc.; 

3 * ^ PerSP6CtiveS With comparison and 

4 * SSue; fr ° m Can ° niCal noncan <>™al information and 

5. Hypertext: imbedded substantive or procedural knowledge with th* 
requirement that the absent element be provided; g * 

6. Choice involving self-selected and teacher selected options; 

7 " fef^a ^indigenous experience examples of 
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8. Individual and cooperative performance opportunities; and 

9 ' WtetaTddB ^tJn e , Xamin ^. generated inventories of 
StTdi^f "^rstancLng: Whet do I know and how do I 
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